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METHOD FOF^ONFIGURING 3D INPUT DEVICE, METHOD FOR 
RECONFIGURING 3D INPUT DEVICE, METHOD FOR RECOGNIZING WEARING 
OF THE 3D INPUT DEVICE, AND THE APPARATUS THEREOF 



BACKGROUND OF THE INVENTION 

This application claims the benefit of Korean Patent Application No. 
10-2002-0087939, filed on December 31, 2002, in the Korean Intellectual Property 
Office, the disclosure of which is incorporated herein in its entirety by reference. 

1 . Field of the Invention 

The present invention relates to a method for configuring a three-dimensional 
(3D) input device, a method for reconfiguring the 3D input device, a method for 
recognizing wearing of the 3D input device, and an apparatus thereof. 

2. Description of the Related Art 

Korean Patent Publication No. 1998-36079 discloses a glove interface 
device for inputting digital data, which includes a glove, which compares digital 
sensors and 3D sensors on fingers, for outputting digital data indicating touch status 
between fingers, position and rotation of a hand and a processor for detecting 
information including the touch status between fingers, the position and rotation of 
the hand based on the digital data received from the glove and providing the 
detected information to a host computer. 

Korean Patent Publication No. 1998-36077 discloses a digital glove input 
device, which includes a sensor block, placed on the fingers, senses a finger 
crooking signal generated with respect to a user's finger crooking and detects finger 
crooking information in response to the finger crooking signal. The digital glove 
input device also includes a control block which generates a motion control signal 
based on the detected finger crooking information. 

In addition, Japanese Patent Publication No. 1996-272520 discloses glove 
instruction call-originating equipment, which includes an extension/contraction 
detecting sensor and a movement recognizing part. The sensor is attached to the 
finger part, the back part, and the palm part of a glove, and simultaneously inputs 
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\s&fs. The movement recognizing part coWnni 



signals of respective sensore. The movement recognizing part cdffffhuously 
processes a group of input signal patterns and synthesizes the provided results so 
as to judge and decide on a certain instruction. 

As described above, there have been many studies involving the development 
5 of devices for inputting information to a computer using the hands or fingers of a user. 
Some of these devices have already experienced real life application. 

Skill level and method of inputting information through a general keyboard 
vary with respect to users. Some users may input information through a QWERTY 
keyboard using only the two index-fingers of both hands, or four or six fingers of both 
10 hands. Others skilled in the QWERTY keyboard may input information using all the 
fingers of both hands. 

Likewise, the skill level and method for inputting information in 3D space using 
a hand-attached device vary with respect to users. Therefore, in an input device 
including ten finger elements for all fingers of both hands, some users may want to 
15 use only four or six finger elements of both hands. Some users may be forced to 
use only several finger elements due to mechanical failures in the rest of the finger 
elements. 

However, ttiere has not been any disclosure of a 3D input device which 
adaptively self-reconfigures finger elements. It is, thus, required to develop a 3D 
20 input device capable of adaptively self-reconfiguring the finger elements, resulting 

improvement in user convenience. Adaptive self-reconfiguration may be needed in 
situations in which a user wants to select which finger elements to use or is forced to 
use only a few of the finger elements due to mechanical failures in the reset of the 
finger elements. 

25 Adaptive self-reconfiguration may also be needed in situations in which a user 

wants to deactivate a specific finger element when wearing the 3D input device, so 
as to change a key array of a keyboard in user or to change a language. 
Currently, there are no disclosures of technology that can determine whether the 
user is wearing the finger elements and determine the positions of the finger 

30 elements. For example, as shown in FIG. 20, if a sensor X1 attached to a finger 

element is malfuctioning and could not generate an edge signal, a recognizing unit of 
the finger element is unable to recognize the finger device. The recognizing unit is 
designed to sequentially recognize sensors X1 , X2, X3, and X4. When the sensor 
X1 malfunctions, it continuously circulates a loop and then cannot determine whether 
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the user is wearing the fing^elernents and the positions of the fing^relements. 
Therefore, the 3D input device cannot be entirely used even when only one finger 
element is malfunctioning. 



SUMMARY OF THE INVENTION 

The present invention provides a method for configuring a three-dimensional 
(3D) input device, a method for reconfiguring the 3D input device, and an apparatus 
thereof, which allows improvement in user convenience. 

The present invention also provides a method for recognizing wearing of the 
three-dimensional (3D) input device and an apparatus thereof, which recognizes 
whether a user is wearing the 3D input device and recognizes the finger element 
positions of the 3D input device. According to an aspect of the present 

invention, there is provided a method of configuring a three-dimensional (3D) 
information input device which performs information input operations using a finger 
device that is worn by a user and senses the user's finger movement. The method 
comprises steps of recognizing whether the user is wearing the finger device and 
recognizing finger positions of the finger device and adaptively configuring the 3D 
input device based on the recognition results. 

According to another aspect of the present invention, there is provided a 
method of reconfiguring a three-dimensional (3D) information input device, which 
inputs information by using a finger device that is worn by a user and senses the 
user's finger movement. The method comprises receiving reset information, used 
for reconfiguration of the 3D information input device, from a user through a user 
interface and reconfiguring a device driver of the 3D input device based on the 
received reset information. 

According to yet another aspect of the present invention, there is provided a 
method of recognizing whether a user is wearing a three-dimensional (3D) input 
device, which includes a finger device with a plurality of sensors attached thereto 
that sense finger movement and input information based on finger movement signals 
sensed by the sensors. The method comprises (a) acquiring sensor signals, which 
are used to sense movement of the finger device, (b) determining, from the acquired 
sensor signals, whether at least the predetermined number of edges are detected, 
and (c) recognizing whether the user is wearing the 3D input device based on the 
results of step (b). 
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According to anotheWspect of the present invention, there i^5rovided a 
three-dimensional (3D) input device, which is adaptively configurable and performs 
information input operation using a finger device that is worn by a user and senses 
the user's finger movement. The 3D input device comprises a pre-processing unit 
5 which recognizes whether the user is wearing the finger device and recognizes the 
finger positions of the finger device and a signal-processing unit which is adaptively 
configured to process movement signals output from the finger device worn by the 
user based on the recognition result of the pre-processing unit. 

-According to another aspect- of the present invention, there is provided an 

10 apparatus for reconfiguring a three-dimensional (3D) input device which performs 
information input operation using a finger device that is worn by a user and senses 
the user's finger movement. The apparatus comprises an application which 
receives reset information, used for reconfiguration of the 3D information input 
device, from a user through a user interface and a device driver which is 

15 reconfigured based on the reset information received from the application. 

According to another aspect of the present invention, there is provided an 
apparatus for recognizing whether a user is wearing a three-dimensional (3D) 
information input device, which performs information input operation using a finger 
device that is worn by the user and senses the user's finger movement. The 

20 apparatus comprises a signal acquiring unit which acquires sensor signals indicating 
movement of the finger device, a port change recognizing unit which determines 
whether at least the predetermined number of edges are detected from the acquired 
sensor signals, and a finger device recognizing unit which recognizes whether the 
user is wearing the finger device, based on the determination result of the port 

25 change recognizing unit. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The above and other features and advantages of the present invention will 
become more apparent by describing in detail exemplary embodiments thereof with 
30 reference to the attached drawings in which: 

FIG. 1 A is a schematic block diagram of a three-dimensional (3D) input device 
according to the present invention; 

FIG. 1 B is a view of a sensing unit attached to the finger device of FIG. 1 A; 
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FIG. 2 is a schemauWIowchart of initializing a configuration offhe 3D input 
device of FIG. 1 A, according to the present invention; 

FIG. 3A is a detailed block diagram of the pre-processing unit of FIG. 1A; 
FIG. 3B is a flowchart illustrating operations in the pre-processing unit of FIG. 
5 3A for initializing configuration of the 3D input device of FIG. 1 A, according to the 
present invention; 

FIG. 4A is a detailed block diagram of the signal-processing unit of FIG. 1 A; 

FIG. 4B is a flowchart illustrating operations in the signal-processing unit of 
FIG. 4A for initializing configuration -of the 3D input device of FIG. 1 A, according to 
10 the present invention; 

FIG. 5A is a detailed block diagram of the device driver of FIG. 1 A; 

FIG. 5B is a flowchart illustrating operations in the device driver of FIG. 5A for 
initializing configuration of the 3D input device of FIG. 1A according to the present 
invention; 

15 FIG. 6A is a detailed block diagram of the application of FIG. 1 A; 

FIG. 6B is a flowchart illustrating operations of the application of FIG. 6A for 
initializing of the configuration of the 3D input device of FIG. 1 A, according to the 
present invention; 

FIG. 7 is a flowchart illustrating operations in the application of FIG. 6A for 
20 reconfiguring the 3D input device of FIG. 1 A according to the present invention; 

FIG. 8 is an exemplary view of a soft keyboard which is outputted from the 
application of FIG. 6A to an output unit; 

FIG. 9 is an exemplary view of the user interface for reconfiguring the 3D 
input device of FIG. 1 A in the application of FIG. 6A; 
25 FIG. 1 0 is a detailed flowchart of operations in the pre-processing unit of FIG. 



FIG. 1 1 is a detailed flowchart of a sensor signal acquisition step in FIG. 10; 
FIG. 12 is a detailed flowchart of a step of calculating a duty ratio and 
recognizing whether a user wears the finger elements in FIG. 1 0; 



1A; 
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FIG. 13 is a detailed flowchart of a step of transmitting signal values of FIG. 



10; 

FIG. 14 is a detailed flowchart of early steps of an algorithm of a 
pre-processing procedure of FIG. 10; 
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iile!rrlowchart of an algorithm for acquiring Tne 



FIG. 15A is a detaile^lowchart of an algorithm for acquiringrne sensor 
signals of FIG. 11; 

FIG. 1 5B is a conceptual view for explaining how to obtain the Currentjnput 
and Lastjnput values in FIG. 15A; 
5 FIG. 15C is a conceptual view for explaining how to obtain VXOR, which 

indicates changes between the currently and previously used values in FIG. 15A; 

FIG. 15D is a conceptual view for explaining how to obtain Port_Status in FIG. 

15A; 

- - FIG. 15E illustrates the data table-obtained after the sensor signal acquisition 
10 in FIG. 15A; 

FIG. 16A is a detailed flowchart of an algorithm for a recognition procedure on 
whether a user is wearing the 3D input device in FIG. 12; 

FIG. 16B is a conceptual view for explaining And-Bit operation of Port-Status 
with Bit-Mask in FIG. 16A; 
15 FIG. 16C is a conceptual view for explaining how to obtain lnit_Edge_Status 

of FIG. 16A; 

FIG. 16D shows the data table obtained after lnit_Edge_Status and Time[ ] 
acquisition in FIG. 16A; 

FIG. 17 is a detailed flowchart of an algorithm for calculating the duty ratio in 
20 FIG. 12; 

FIG. 18A is a detailed flowchart of an algorithm for transmitting the signal 
values in FIG. 13; 

FIG. 18B is a conceptual view for explaining how to obtain No_Exist_Signals 
in FIG. 18A; 

25 FIG. 19 illustrates sensor signals when all sensors X1, X2 f X3, and X4, which 

are attached to the finger elements, operate normally; and 

FIG. 20 illustrates a sensor output signal when the sensor X1 operates 
abnormally. 

30 DETAILED DESCRIPTION OF THE INVENTION 

The present invention now will be described more fully with reference to the 
accompanying drawings, in which preferred embodiments of the invention are 
shown. 

. FIG. 1A illustrates an example of a three-dimensional (3D) input device 100, 
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according to the present invention. 

The 3D input device 100 includes an information input finger device 110 
(hereinafter referred to as a finger device), a signal-processing device 120, and a 
computer 150. FIG. 1 shows the entire configuration necessary for information 
5 input. However, hereinafter, the configuration of the 3D input device 100 will be 

described as it relates to initialization of the 3D input device 100, i.e., the operation of 
adaptively configuring or reconfiguring the 3D input device 100. 

The finger device 1 1 0 includes a first sensor (X1 ) 1 1 1 , a second sensor (X2) 
112, a third sensor (X3) 113, and a fourth sensor (X4) 114, as a sensing means for 
1 o sensing finger movements. At the base of the finger device 110, there is a 

connection unit 115 that connects the finger device 1 10 with a signal-processing 
device 120. 

Each sensor 111, 112, 1 1 3, or 1 1 4 may include an acceleration sensor 116 
and an angle sensor 117 as shown in FIG. 1B. A signal outputted from the 

15 acceleration sensor 1 16, a sensing one on finger movement acceleration, can be 

used as a clock signal, namely an information input signal. A signal outputted from 
the angle sensor 117, a sensing one on an angle between the first and second 
knuckles of a finger, can be used as an information selection signal. 

The sensors, however, are not limited to those described above. The 

20 present invention may include any other kind of sensors capable of sensing the 
finger's movement to output signals for information input or information selection. 
For example, a sensor outputting a digital signal, e.g., an inertial sensor, or a sensor 
outputting an analog signal, e.g., a potentiometer, a Giant Magnetoresistive (GMR) 
sensor, an optical sensor, an on/off switch, or a pressure sensor, can be used in the 

25 present invention. 

The signal-processing device 120 receives and processes a signal outputted 
from the sensors 111, 112, 113, and 114 of the finger device 110. The 
signal-processing device 120 may be mounted on the back of a user's hand. The 
signal-processing device 120 includes a pre-processing unit 130 and a 

30 signal-processing unit 140. The pre-processing unit 130 receives the signals 

outputted from the finger device 1 10 via the connection unit 1 15through a cable or 
air in a wired or wireless manner, and recognizes the finger device 110 worn by the 
user. The signal-processing unit 140 receives finger device recognition information 
- outputted from the pre-processing unit 130, self-configures the signal-processing 
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device 120 based on the finger device recognition information, processes finger 
movement information outputted from the sensors 111, 112, 113, and 114 based on 
a selected algorithm, extracts movement characteristic information from the finger 
movement information, and transmits the movement characteristic information to a 
5 device driver 160 of the computer 150 through a connection, such as a Universal 
Serial Bus (USB). Here, self-configuration of the signal-processing unit 140 refers 
to self-configure the firmware, namely algorithm. For example, if the finger device 
recognition information is for three fingers, the signal-processing unit 140 
self-configures an algorithm in order to process three signals outputted from three 
10 sensors. 

The computer 150 includes the device driver 160 and the application 170. 
The device driver 160 configures itself based on basic set-up information and the 
movement characteristic information received from the signal-processing unit 140 
and then reconfigures itself based on reset information received from the application 

15 170. Basic set-up information denotes input scenario information including a 

language in use or key array of a keyboard, etc. The application 170 receives the 
basic set-up information and the movement characteristic information from the 
device driver 160, transmits a soft keyboard to an output device (not shown) based 
on the received basic set-up information, interprets the received movement 

20 characteristic information, and outputs input information items based on the 

interpreted movement characteristic information to the output device (not shown) or 
another application (not shown). In addition, the application 170 allows the user to 
reconfigure the 3D input device 100 through a user interface. 



In the first step, S21 0, a user wears the finger device 110. In step S220, 
sensor signals are output from the sensors 111, 112, 113, and 114 included in the 
finger device 110. The pre-processing unit 130 receives sensor signals. 

The pre-processing unit 130 recognizes whether the user is wearing the finger 
30 device 110 and recognizes the position of the finger device 110, based on the 
received sensor signals (step S230) and transmits finger device recognition 
information with finger movement information outputted from the sensors 111, 112, 
113, and 114, to the signal-processing unit 140. 



25 



FIG. 2 is a schematic flowchart 200 of initializing a configuration of the 3D 
input device 100, according to the present invention. 



The signal-processing unit 140 configures firmware based on the finger 



natron in step S240, processes the finger mov< 



device recognition information in step S240, processes the finger movement 
information, and transmits movement characteristic information to the device driver 
160. 

The device driver 160 configures itself based on the movement characteristic 
5 information and basic set-up information (step S250). 

The application 170 outputs a soft keyboard on which positions of fingers are 
displayed to the output device (not shown) according to the configuration information 
of the device driver 160 (step S260), interprets the movement characteristic 
-information of the finger device 110, and performs information input procedure (step 
10 S270). 

Hereafter, each element of FIG. 1 A and an operation of initialization of 
configuration will be described with reference to FIGS. 3A through 9. 

FIG. 3A is a detailed block diagram ofthe pre-processing unit 130 of FIG. 1A, 
and FIG. 3B is a flowchart of initialization operations in the pre-processing unit 130 of 

15 FIG. 3A for configuration of the 3D input device, according to the present invention. 
With reference to FIGS. 3A and 3B, configuration and operation ofthe 
pre-processing unit 130 will be described. 

The pre-processing unit 130 of FIG. 3A includes a first port 131, a second port 
132, a third port 133, and a fourth port 134 that receive sensing information from the 

20 finger device 1 10, a port change recognizing and storing unit 135 that recognizes 
changes between previous and current times in each port, an output value 
calculating unit 136 that calculates output values using values stored in the port 
change recognizing and storing unit 135, and an output value transmitting unit 137 
that transmits the calculated outputs to the signal-processing unit 140. 

25 The pre-processing unit 130 initializes hardware and software therein (step 

S310). 

After that, the pre-processing unit 130 receives the sensor signals from the 
first sensor 111, the second sensor 112, the third sensor 113, and the fourth sensor 
1 14 ofthe finger device 110 (step S320). The first port 131, the second port 132, 
30 the third port 133, and the fourth port 134, respectively, detect the sensor signals. 

The sensor signals include signals for information item selections and signals for the 
information input. The information item selection denotes selecting an information 
item among a plurality of information items, for example, selecting a character key 
among a plurality of character keys. „ The information input denotes clicking the 
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selected character key. 




In step S330 t it is recognized whether the user is wearing the finger device 
110 and the finger positions of the finger device 110 using the received sensor 
signals. The sensor signals used to recognize the finger device 1 1 0 may be the 
5 signals for the information item selections or the signals for the information input. 

However, hereinafter, the sensor signals means the information input signals output 
from the acceleration sensor 116. In addition, the finger device recognition 
information refers to which sensor information about sensor usage and finger 
position.^ Step S330 may be performed by-the port change recognizing and storing 

10 unit 135 and the output calculating unit 136, which will be described in detail later. 

Next, the output transmitting unit 137 transmits the finger device recognition 
information and sensor signals to the signal processing unit 140 (step S340). The 
finger device recognition information denotes information recognized by the 
pre-processing unit 130, and the sensor output signals denote the finger movement 

1 5 information of the finger device 110. 

FIG. 4A is a detailed block diagram of the signal-processing unit 140 of FIG. 
1 A, and FIG. 4B is a flowchart of operations in the signal-processing unit 140 of FIG. 
4A for initializing configuration of the 3D information input device, according to the 
present invention. With reference to FIGS. 4A and 4B, configuration and operation 

20 of the signal-processing unit 140 of the signal-processing device 120 will be 
described. 

The signal-processing device 140 of FIG. 4A includes a finger device 
self-configuring unit 141 and a finger movement information processing unit 142. 
The finger device self-configuring unit 141 receives the finger movement information 
25 and the finger device recognition information from the pre-processing unit 130, and 
self-configures the finger device 110 based on the received finger device recognition 
information. The finger movement information processing unit 142 extracts 
movement characteristic information by processing the received finger movement 
information based on an algorithm of the self-configured finger device 110. 
30 Hereinafter, the operation of the signal-processing unit 140 will be described 

with reference to FIG. 4B. 

The signal-processing unit 140 initializes its hardware and software in step 
S410. After the finger device self-configuring unit 141 receives the finger device 
. . recognition information and the sensor signals from the pre-processing unit 130 (step 
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S420), the finger device seTTconfiguring unit 141 deactivates algontffms on the 
unworn sensors and configures the firmware subsequently based on the received 
finger device recognition information (step S430). For example, if the finger device 
self-configuring unit 141 receives finger device recognition information indicating the 
user is wearing the second 112, third 1 13, and fourth 114 sensors, the finger device 
self-configuring unit 141 sets up algorithms used to process the signals received 
from the second 112, third 113, and fourth 114 sensors and deactivates the other 
algorithms. 

' In step S440, the-finger movement-information processing unit 142 executes 
the signal processing algorithms on the signals output from the worn sensors based 
on the configured firmware. That is, the finger movement information processing 
unit 142 inputs the received sensor signals to the algorithms on the second 112, third 
113 and fourth 114 sensors, calculates the selection information obtained by the 
operation of the finger device 110, and determines whether operations of the finger 
device 110 correspond to information input. For example, the finger movement 
information processing unit 142 calculates the positions of fingers to determine which 
information items are selected by the corresponding fingers, determines keys which 
correspond to the calculated positions of fingers, or determines whether the 
operations of the finger device 110 correspond to information input by evaluating 
whether signal values for the information input have crossed a predetermined 
threshold. The calculation results of the selection information and determination 
results to input operations become the movement characteristic information. 

After that, the finger movement information processing unit 142 transmits the 
movement characteristic information, and the previously received finger device 
recognition information to the device driver 160 of the computer 150 in step S450. 
The signal-processing unit 140 may use USB to transmit the movement 
characteristic information to the device driver 160 of the computer 150. 

FIG. 5A is a detailed block diagram of the device driver 160 of FIG. 1A, and 
FIG. 5B is a flowchart of operations in the device driver 160 of FIG. 5A for initializing 
the configuration of the 3D input device 100, according to the present invention. 
With reference to FIGS. 5A and 5B, configuration and operation of the device driver 
160 of the computer 150 will be described. 

The device driver 160 of FIG. 5A includes a device driver 
self^configuring/reconfiguring unit 161 and a set-up information and movement 
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characteristic information IWwarding unit 162. The device driver^^ 
self-configuring/reconfiguring unit 161 receives the finger device recognition 
information and the movement characteristic information from the signal-processing 
unit 140 and configures the device driver 160 based on the received finger device 
recognition information and basic set-up information. The set-up information and 
movement characteristic information forwarding unit 162 forwards the set-up 
information set by the device driver configuring/reconfiguring unit 161 , and the 
movement characteristic information received from the signal-processing unit 140 to 
— the application 170. 

Hereinafter, the operation of the device driver 160 will be described with 
reference to FIG. 5B. 

In the first step S510, the device driver 160 initializes itself and the application 

170. 

Next, the device driver configuring/reconfiguring unit 161 receives the finger 
device recognition information and the movement characteristic information from the 
signal-processing unit 140 (step S520). In step S530, the device driver 
configuring/reconfiguring unit 161 configures the device driver 160 based on the 
received finger device recognition information. Here, preset default values are used 
for other selection information excluding the received finger device recognition 
information. The other selection information refers to, for example, input scenario 
information related to a kind of keyboard or a language used for information input. 

If there is a call from the signal-processing device 120 (step S540), the device 
driver self-configuring/reconfiguring unit 161 acquires the finger device recognition 
information from the signal-processing device 120 (step S550) and reconfigures the 
device driver 160 based on the acquired finger device recognition information. For 
example, if a user is wearing four sensors on four fingers and takes one of them off, 
the device driver configuring/reconfiguring unit 161 receives new finger device 
recognition information from the signal-processing device 120 and reconfigures the 
device driver 160 based on the received finger device recognition information. 

If it receives a call from the application 170 in step S560, the device driver 
configuring/reconfiguring unit 161 acquires the basic set-up information from the 
application 170 (step S570) and reconfigures the device driver 160 based on the 
acquired set-up information. At first, the device driver configuring/reconfiguring unit 
161 configures the device driver 160 by default values for the input scenario and 
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user language. After tharnhe user can change the input scenariror the user 
language through a user interface (not shown) provided by the application 170. In 
this case, the device driver configuring/reconfiguring unit 161 acquires the set-up 
information from the application 170 to self-configure the device driver 160. 

In step S580, the set-up information and movement characteristic information 
forwarding unit 162 forwards the received movement characteristic information and 
set-up information to the application 170. 

FIG. 6A is a detailed block diagram of the application 170 of FIG. 1A, and FIG. 
6B is a flowchart of operations in the application 170 of FIG. 6A for initializing 
configuration of the 3D input device, according to the present invention. With 
reference to FIGS. 6A and 6B, configuration and operation of the application 170 will 
be described. 

The application 170 of FIG. 6A includes a soft keyboard displaying unit 171, 
which receives the movement characteristic information and the set-up information 
from the device driver 160, and displays the soft keyboard on an output device 180; 
a movement characteristic information interpreting unit 172, which interprets the 
received movement characteristic information; an information input unit 173, which 
inputs information based on the interpreted movement characteristic information; and 
a user setting unit 174 which allows a user to reconfigure the 3D input device of FIG. 
1A. 

Hereinafter, the operations in the application 170 will be described with 
reference to FIG. 6B. 

The soft keyboard displaying unit 171 receives the movement characteristic 
information and the set-up information from the device driver 160 (step S610). 

In step S620, the soft keyboard displaying unit 171 displays finger positions 
on a soft keyboard displaying finger positions based on the received set-up 
information and transmits the soft keyboard to the output device 180 (step S620). 
FIG. 8 shows an example of the soft keyboard displayed on the output device 180. 
As shown in FIG. 8, an adopted language is English and the input scenario is a 
cellular phone-type. It is also known that three sensors are connected. 

The movement characteristic information interpreting unit 172 interprets the 
received movement characteristic information in step S630. As described 
previously, the movement characteristic information includes the calculation results 
of the selection information and the determination results of whether there is any 
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c^^ient characteristic interpreting unit 



input operation. The movement characteristic interpreting unit l^flriterprets the 
calculation results and determines the keys which correspond to the selected 
information. In addition, the movement characteristic interpreting unit 172 interprets 
the determination results of whether there is any input operation and decides 
5 whether to process the determination results as an information input. 

Next, the information input unit 173 accepts information corresponding to the 
interpreted results of the movement characteristic information interpreting unit 172 in 
step S640. 

- - FIG. 7 is a flowchart-7GQ^of-operations in the application 1 70 of FIG. 6A for 
10 reconfiguration of the 3D input device of FIG. 1A, according to the present invention. 
Reconfiguration of the 3D information input device can be performed by the user 
setting unit 174 of the application 170. 

In the first step S710, the application 170 receives a user request for manual 
setting of the 3D input device 110. The manual setting can be performed by the 
15 user using the user interface shown in FIG. 9. The user interface may be included 
in a control board 900 provided by Microsoft Windows in a form of keyboard 
registration information 910 as general keyboard registration information. 

The user requests a setting change permission or cancel of use on a specific 
sensor (step S720), selects an input scenario in step S730, or selecting a user 
20 language in a manual setting menu (step S740). As shown in FIG. 9, the user 

interface allows the user to select keyboard type, key arrays, fingers to use, and the 
user language. 

When the application 170 receives such requests of changes, it transmits the 
set-up information to the device driver 160 (step S750), and then the device driver 
25 160 reconfigures itself based on the received set-up information (step S760). 

Components and their operations for initializing a 3D input device, especially 
recognizing a finger device and configuring the 3D input device based on finger 
device recognition information, are described hitherto. Hereinafter, detailed 
operations of the pre-processing unit 130, which recognizes the finger device 110, 
30 will be described. 

FIG. 10 is a schematic flowchart 1000 of operations in the pre-processing unit 
130 of FIG. 1A. 



14 



i^^it 130 initializes a system (step S10^^r 



The pre-processin^Thit 130 initializes a system (step SIOlTTTand acquires 
sensor signals from the finger device 1 1 0 (step S1 020). The operations for 
receiving the sensor signals will be described in detail with reference to FIG. 11. 
The pre-processing unit 130 calculates a duty ratio of the received signal 
5 (step S1030), and then recognizes whether a user is wearing the finger device based 
on the received sensor signals (step S1040). The operations for calculating the 
duty ratio and recognizing whether the user is wearing the finger device will be 
described in detail with reference to FIG. 12. 

- — - - -The pre-processrng unit 130 transmits signal values having the calculated 

10 duty ratio and an identification factor in which the finger device recognition 
information is stored to the signal-processing unit 140 (step S1050). The 
operations for transmitting the signal values and the identification factor to the 
signal-processing unit 140 will be described in detail with reference to FIG. 13. 
Hereinafter, the operation of acquiring the sensor signals from the finger 
15 device 110 will be described in detail with reference to FIG. 11. The number of 
ports may be as many as the number of the sensor signals. In this description, 
each point value may be used as each sensor signal which passes corresponding 
port through. 

The pre-processing unit 130 receives current port values outputted from 
20 sensors 111, 112, 113, and 114 of the finger device 110 (step S1110). The current 
port values are stored as previous port values after a predetermined amount of time. 

Next, the pre-processing unit 130 determines whether there is any change 
between the current port values and the previous port values (step S1 120). A 
change in a port value means that an edge is triggered in a signal which passes the 
25 corresponding port through. 

Next, the pre-processing unit 130 stores the current port values and 
information on the ports having port value changes in port status variables (step 
S1130). 

The pre-processing unit 130 stores a timer value at a current time when the 
30 port status variables are written with the port values and port information in an event 
time variable (step S1 140). Namely, the current timer value indicates a time when 
the edge is triggered. 

FIG. 12 is a detail flowchart of steps 1030 and 1040 of FIG. 10. 
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In the first step S12rTT, the pre-processing unit 130 determines whether three 
edge-triggered-times can be obtained from each sensor. The edge-triggered-time is 
stored in the event time variable. When three event time variables for each sensor 
are obtained, the three event time variables are stored in time[0], time[1], and 
time[2]. 

If the three edge-triggered-times cannot be extracted from each sensor, an 
error value is stored in an output variable (step S1240). In detail, the fact that the 
three edge-triggered-times cannot be extracted means that the edge is triggered less 
than three times for a predetermined time -period. This indicates the sensor is not - 
operating normally. Consequently, the error value is written to the output variable. 

If the three edge-triggered-times can be extracted, the pre-processing unit 
130 stores the initial edge state for each sensor (step S1220). 

In step S1230, the pre-processing unit 130 calculates a scale value based on 
the event time variables and stores the calculated scale value to the output variable. 

In step S1250, the pre-processing unit 130 stores a minimum threshold in the 
output variable if the stored scale value is less than the minimum threshold. In step 
S1260, the pre-processing unit 130 stores a maximum threshold in the output 
variable if the stored scale value is greater than the maximum threshold. 

FIG. 13 is a detail flowchart of step 1050 of FIG. 10. 

In the first step S1310, the pre-processing unit 130 checks the output variable 
having the error value, and stores the value in a no-signal variable. The no-signal 
variable includes information indicating a sensor is not normally outputting a sensor 
signal. 

In step S1320, the pre-processing unit 130 transmits the output variable and 
the value included in the no-signal variable to the signal-processing unit 140. 

FIGS. 14 through 20 show a detailed algorithm used in the pre-processing 
unit 130 to recognize whether a user is wearing a finger device and to recognize the 
finger positions of the finger device. 

Referring to FIG. 14, the pre-processing unit 130 initializes the system (step 
S1401 ) and proceeds to TV if an interrupt occurs in step S1402. 

Referring to FIG. 15A, the pre-processing unit 130 initializes variables (step 
S1501), more specifically, setting the values of Transition_Counter and 
lnput_Counter to '0'. 
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Next, the pre-procesfthg unit 130 inputs a current port valuCTnto 
Currentjnput and a previous port value into Lastjnput (step S1 502). The 
pre-processing unit 130 sequentially arranges values captured from N ports at urrent 
time and stores them in Currentjnput. Here, N refers to the number of sensors 
worn on the fingers or the number of click signals. In a present embodiment, N is 4. 
For example, as shown in FIG. 1 5A, if current port values outputted from the first 
sensor X1 , the second sensor X2, the third sensor X3, and the fourth sensor X4 
correspond to 1 , 0, 1 , 0, the pre-processing unit 130 stores 0000 0101 in 
Currentjnput. The pre-processing unit 130 then sets Lastjnput to Current-Input 
and initializes a timer. 

Next, the pre-processing unit 130 determines whether a value in 
Transition JDounter is less than the threshold value Ntc in step S1503. The 
threshold value Ntc may be 60, which indicates steps S1504 through S1510 are 
repeated 60 times, if Transition JItounter value is less than the threshold value Ntc, 
the pre-processing unit 130 proceeds to step S1504. Otherwise, the pre-processing 
unit 130 proceeds to B. 

In step S1504, The pre-processing unit 130 captures current port values and 
stores the captured current port values in Currentjnput. 

In step S1505, the pre-processing unit 130 performs signal combination to 
determine whether there is any change between the current port values and the 
previous port values. The pre-processing unit 130 stores the results of an XOR 
operations of Lastjnput, values and Currentjnput values. In a variable of VXOR 
as shown in FIG. 15C. It is assumed that Currentjnput and Lastjnput store 
values of 0000 01 1 1 and 0000 0101 , respectively. After XOR operated between the 
values of Currentjnput and Lastjnput, it is known that bits of the second sensor X2 
have a change. Because an operation result of '0' indicates no bit change and T 
does a bit change. Consequently, a value of 0000 0010 is stored in VXOR. 

Next, in step S1506, the pre-processing unit 130 determines whether the 
VXOR value is '0' in step S1506. 

If the VXOR value is '0', there is no change between the current port values 
and the previous port values, indicating that any edge (rising edge or falling edge) is 
not triggered in any sensor signal. Therefore, the pre-processing unit 130 proceeds 
to step S1510 and sets Lastjnput to Currentjnput and proceeds to step S1503. 
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If the VXOR value iWTot '0', the pre-processing unit 130 manipulates its 
variables by increasing the Transition__Counter value by 1 , adding the VXOR value to 
a value of N-bit left shifted Currentjnput value, and storing the added result in 
Port_Status [lnput_Counter] (step S1507). As shown in FIG. 15D, the 
Currentjnput value of 0000 0111 is 4-bit left shifted to the result 01 1 1 0000. If 
0000 001 0 of the VXOR value is added to the left shifted Currentjnput value, 0111 
0010 is stored in PortJBtatus [lnput_Counter]. The first four bits of the 8-bit 
Port_Status indicate current sensor values, and the remaining four bits indicate an 
edge-triggered. - In FIG. 15D, therPort-~Status value indicates the current sensor 
values of [X1 X2 X3 X4] are [111 0], and the edge-triggered-sensor is X2. 

In step S1507, the pre-processing unit 130 stores a current timer value in 
Event J~ime[lnputJ3ounter] in step S1507. 

In step S1508, the pre-processing unit 130 increases lnput_Counter by 1. 

In step S1509, the pre-processing unit 130 determines whether the 
lnput_Counter value is greater than a threshold value Nic. The threshold Nic value 
may be set to 23. 

If the lnput_Counter value is greater than the threshold value Nic, the 
pre-processing unit 130 proceeds to B. If the lnput_Counter value is less than or 
equal to the threshold value Nic, the pre-processing unit 130 stores the 
Currentjnput value in Lastjnput in step S1510 and proceeds to step S1503. 

As a result of the operations shown in FIG. 15A, the data table of FIG. 15E is 
obtained, with the information: lnput_Counter, Currentjnput which stores the current 
port value; Lastjnput which stores the previous port value; VXOR which indicates a 
change in the current port value or the previous port value; Transition_Counter; 
Port_Status which indicates the current port value and information on a 
change-stricken, namely an edge-triggered port; and Event_Time which represents 
the time when the edge is triggered. For example, in FIG. 15E, at current time 
when Transition JDounter is 12, the current port value is 1010, the change-stricken 
sensor is the third sensor, and the current timer value is 450. 

Hereinafter, operations after B will be described with reference to FIG. 16A. 

The operations after B include recognizing a sensor that does not operate 
normally based on the data of FIG. 15E and obtaining the predetermined number of 
the edge-triggered time, namely the timer values for a sensor that operates normally. 
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In step S1601, the^SfE-processing unit 130 sets BitJVIask aWoOO 0001 and 
count as '0'. 

In step S1602, the pre-processing unit 130 determines whether the count 
value is less than N (step S1 602). Step S1 602 for determining whether the 
operations hereinafter are performed as many as the number of sensors worn on 
fingers. 

If the count value is less than N, the pre-processing unit 130 proceeds to step 
S1603, otherwise, the pre-processing unit 130 proceeds to F. 

^„,_- . ln~steps<S1603 and S1604, the pre-processing-unit 130 sets-Edge-Counter to 
'0' and Port_Status_Counter to '0\ 

In step S1605, the pre-processing unit 130 determines whether the 
Port_Status_Counter value is less than a value of lnput_Counter+1 . If the 
Port_Status_Counter value is not less than the value of lnput_Counter+1, the 
pre-processing unit 130 proceeds to 'D\ In step S1612, the Port_Status_Counter 
value is increased sequentially by 1 . lnput_Counter may store a value of 23. That 
the Port_Status_Counter value is not less than the value of lnput_Counter+1 means 
an Edge_Counter alue is possibly smaller than 2 (step S161 1 ). And also, only the 
Port_Status_Counter value gets increased by 1 (step S1612), which results excess 
of the lnput_Counter value. That is, no more than two edges have been triggered in 
a sensor signal outputted from a sensor for a predetermined amount of time, 
indicating the sensor does not operate normally. Therefore, the pre-processing unit 
130 proceeds to 'D' and stores the error value in the output variable. 

If the Port_Status_Counter value is less than the value of lnput_Counter+1, 
the pre-processing unit 130 determines whether the result of an AND_bit operation 
of Port_Status[Port_Status_Counter] and BitJVIask is '0' in step S1606. AND_bit 
denotes the bit-wise AND operation. Referring to FIG. 16B, an AND_bit operation 
of Port_Status[3] having 1110 0001 (with reference to the data table of FIG. 15E) 
and BitJVIask having 0000 0001 results in the value T. Since the result is not *0\ 
the pre-processing unit proceeds to step S1607. 

The pre-processing unit 130 then proceeds to store an 
Event_Time[Port_Status__Counter] alue in Time[Edge_Counter] in step S1607 and 
determines whether the Edge JDounter value is '0' in step S1608. 

Unless the Edge_Counter value is *0\ the pre-processing unit 130 increases 
the Edge J^ounter value, by 1 in step S1610. If the Edge_Counter value is '0', in 
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step S1609, the pre-proceSsing unit 130 performs the AND_bit operation of 
Port_Status[Port_Status__Counter] and N-bit left shifted Bit_Mask, storing the 
AND_bit operation result in lnitJEdge_Status. For example, as shown in FIG. 16C, 
the AND_bit operation of Port_Status having 1110 xxxx and N-bit left shifted 
BitJWask, 0001 0000 results out '0\ The pre-processing unit 130 stores '0' in 
lnit_Edge_Status. 

In step S1610, the pre-processing unit increases the Edge_Counter value by 

1. 

Next, in -step S1611, the pre-processing-unit 430 determines whether the — 
Edge_Counter value is greater than '2', a satisfactory value for calculating a duty 
ratio of the sensor signal. 

If the Edge_Counter value is greater than 2, the pre-processing unit 130 
proceeds to 'C\ If the Edge_Counter value is not greater than 2, the pre-processing 
unit 130 increases the Port_Status__Counter value by 1 in step S1612 and proceeds 
to step S1605. 

Operating the values in the data table of FIG. 15E according to the algorithm 
of FIG. 1 6A produces the values in the data table of FIG. 1 6D. Each sensor obtains 
values for lnit_Edge_Status, Time[0], Time[1], and Time[2]. For example, in a case 
of the first sensor X1 , as shown in FIG. 1 5E, when a port value for the first sensor X1 
is '1' corresponding Transition_Counter values are '3', *7\ and '11', and 
corresponding Event_Time values are 130, 280, and 430. In FIG. 16D, the 
lnit_Edge_Status value of the first sensor X1 is '0' based on the current port signal of 
Port_Status [3]. This information is stored in FIG. 16D. However, it is noted that 
FIG. 16D shows information when all sensors X1, X2, X3, and X4 operate normally. 

Hereinafter, operations after 'C will be described with reference to FIG. 17. 

In the first step S1701, the pre-processing unit 130 determines whether the 
lnit_Edge_Status value is '0' (step S1701). Reflecting the determination result, a 
duty ratio for the sensor signal is calculated. If the lnit_Edge_Status value is not '0', 
the pre-processing unit 130 stores Scale_Factor * 

(Time[1]-Time[0])/(Time[2]-Time[0]) in an output variable Output[count] (step S1702). 
If lnit_Edge_Status is '0\ the pre-processing unit 130 stores 
Scale_Factor*(Time[2]-Time[1])/(Time[2]-Time[0]) in the output variable 
Output[count] (step S1 703). Scale_Factor is for signal transmission. For example, 
if a calculated output value is to be transmitted in an 8-bit signal, the output variable 
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value may be in a range dro - 225. Thus, for example, the Scale^actor value 
may be 225. 

The pre-processing unit 130 determines whether the value of the output 
variable Output[count] is less than Min_Value, e.g., T, in step S1704. If so, the 
pre-processing unit 130 stores Min_Value in the output variable Outputfcount] (step 
S1705) and proceeds to step S1709. 

Otherwise, the pre-processing unit 130 determines whether the output 
variable Output[count] value is greater than Max_Value, e.g., '255' (step S1706). If 
so,4he pre-processing unit 130 stores Value_Something_Wrong in the output 
variable Output[count] (step S1707), and proceeds to step S1709. 

In D, the pre-processing unit 130 stores Value_Something_Wrong in the 
output variable Output[count] in step 1708, and proceeds to step S1709. Since the 
output variable value stored according to the duty ratio calculation may have from 
Min_Value of T o Max_Value of '225', Value_Something_Wrong may be '0', which 
is not used as the output variable alue. 

In step S1709, the pre-processing unit 130 shifts Bit_Mask to left direction by 
1 bit and stores the result in BitMask. 

Next, the pre-processing unit 130 increases count by 1 in step S1710, and 
proceeds to 'E'. 

Hereinafter, operations after F will be described with reference to FIG. 18A. 

In step S1801, the pre-processing unit 130 sets the BitJVIask value to 0000 
0001 , count value to 0, and No_Exit_Signals value to 0000 0000. 

Next, in step S1802, the pre-processing unit 130 determines whether the 
count value is less than N. The count value greater than or equal to N means all 
operations in the pre-processing unit 130 have been completed. In this case, the 
pre-processing unit 130 proceeds to step S1807. 

If the count value is less than N, the pre-processing unit 130 determines 
whether Output[count] has Value_Something_Wrong in step S1803. 

If outputfcount] does not have VaIue__Something_Wrong, the pre-processing 
unit 130 proceeds to step S1805 and increases the count value by 1. 

If outputfcount] has Value J5omethingJA/rong, the pre-processing unit 130 
stores the summation result of a value of NoJExistJSignals (variable indicating the 
number of existing signals) and the Bit_Mask value in No_Exist_Signals in step 
S1804. For example, as shown in FIG. 18B, if BitJVIask having 0000 0001 is added 
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to No_Exist_Signals havin^OOO 0000, the summation result, OOOcroOOl, is stored 
in NoJExist_Signals. No_Exist_Signals having 0000 0001 indicates that the first 
sensor X1 is not operating normally or is not being worn by the user. 

Next, in step S1806, the pre-processing unit 130 shifts BitJVIask to left 
direction by 1 bit, stores the result in Bit_Mask, and proceeds to step S1802. 

In step S1807, the pre-processing unit 130 transmits Output[1],...,Output[n], 
No_Exist_Signals to the signal processing unit 140. For example, if output[1], 
output[2] and No_Exist_Signals = [0000 1 100] are outputted that the first sensor X1 
and the second sensor X2 are not being^worn-by a user, and the third sensor X3 and 
the fourth sensor X4 are being worn by the user. 

Thus, it is possible for the pre-processing unit 130 to recognize the sensors 
being worn by the user and those not being worn by the user. 

According to the present invention, it is possible to implement a user-friendly 
3D input device by automatically or manually configuring the 3D input device. 

While the present invention has been particularly shown and described with 
reference to exemplary embodiments thereof, it will be understood by those of 
ordinary skill in the art that various changes in form and details may be made therein 
without departing from the spirit and scope of the present invention as defined by the 
following claims. 
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